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Abstract 


Several  simple  queueing  models,  which  are  commonly  used  as 
text  book  examples,  have  explicit  steady*‘State  solutions,  which 
to  date  have  escaped  notice.  These  solutions  are  easily  confutable 
In  addition  to  their  didactic  interest,  the  results,  presented 
here,  are  also  useful  in  the  analysis  of  more  complex  queueing 
models. 


KSy  Words 

Theory  of  Queues,  phase  type  distributions,  computational  pro¬ 
bability,  finite  queues,  explicit  solutions. 
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1 .  Introduction 

The  queueing  models  M/E^l  and  E^M/c  and,  to  a  lesser 

o 

extent,  their  bounded  versions  and  are 

familiar  topics  in  texts  dealing  with  the  theory  of  queues.  The 
analysis  is  mostly  based  on  transform  methods.  Even  when  clearly 
and  succinctly  presented,  as  e.g.  in  Kleinrock  [11,  this  analysis 
involves  a  number  of  formal  steps,  which  are  difficult  to  the 
student  lacking  in  mathematical  maturity.  The  same  comments  apply 
to  the  discussions  of  the  M/H^l  queue  and  similar  models,  in 

which  the  Erlang  distribution  is  replaced  by  the  hyperexponential 
distribution.  The  number  of  joumal  articles,  devoted  to  these 
particular  queues,  is  very  large.  A  substantial  number  of 
references  may  be  found  in  C5];  they  will  be  omitted  here. 

The  purpose  of  this  paper  is  to  show  that,  even  with  E^ 

replaced  by  a  probability  distribution  of  phase  type  (PH)  [2,  3,  5], 
these  queues  have  highly  tractable  steady-state  solutions.  Except 
in  the  case  of  the  unbounded  PH/M/c  queue,  these  solutions  are 
fully  explicit  and  require  only  the  evaluation  of  one  or  more 
readily  computed  matrix  inverses. 

We  recall  that  a  PH-dlstribution  F  (* )  with  representation 
(a,  T)  is  the  distribution  of  the  time  till  absorption  in  ehe 
in  the  (m  t  1)  -  state  Markov  process  with  generator 

T  T°  I 

0  0 
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and  initial  probability  vector  (a,  %<fl^*  square  matrix  T 

is  nonsingular,  has  negative  diagonal  elements,  nonnegative  off- 

diagonal  elements  and  satisfies  Te  +  «  0.  In  order  to  avoid 

trivial  considerations,  we  shall  assume  that  «  0,  so  that 

the  row  vector  a  is  a  probability  vector.  We  further  assume 

(without  loss  of  generality)  that  the  matrix  T  +  T^*a  is 
irreducible.  The  representation  (a,  T)  is  then  said  to  be 
irreducible. 

The  mean  of  F(*)  is  given  by  p£  *  -  oiT“^e,  The 

irreducible  generator  T  +  T°‘a  has  a  unique,  positive  station¬ 
ary  vector  £  ,  which  is  given  by 

(1)  1  *  ”  pj[oT”^ . 

The  probability  distribution  F(*)  itself  is  given  by 

(2)  F{x)  ■  1  -  o  exp  (Tx)e,  for  x  ^  0, 

and  it,  as  well  as  its  density,  are  readily  computed  by  the 
numerical  solution  of  the  system  of  differential  equations 

v' (x)  -  v(x)T,  for  X  2  0, 

v(0)  -  «, 

(3) 

F(x)  -  1  -  v(x)e, 

F'  (x)  ■  v(x)^. 


for  X  2  0. 
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The  familiar  (generalieed)  Erlang  and  hyperexponential  dis¬ 
tributions  are  particular  PH-distributions ,  respectively  with 
representations 


I 

I 


\ 


1 


T 


X 


2 


I 

r  01  *  (If  Of  •••f0)f 


with 


Xj  >  Of  for 


1  ^  j  ^  nif  and 


T  =  diag  (-Xj^f  ...f  -1^^) » 


O  ■  (Oj^f  ttj#  ...»  cij^) » 


with  Xj  >  Of  ttj  >  Of  for  1  1  j  £  m. 


The  following  lemmas  are  basic  to  the  sequel. 

Lemma  1 

Let  (Uf  T)  be  an  irreducible  representation f  then  for 
X  >  Of  then  matrix  XI  -  ^S.*SL  ~  ^  is  nonsingular. 

Its  inverse f  which  is  given  by 

(4)  (XI  -  Xe*a  -  T)"^  -  (XI  -  T)“^  +  (XI  -  T)"^  e*o  (XI  -  T)"\ 

is  strictly  positive.  The  quantity  f(X)  is  equal  to  the  Laplace- 

Stieltjes  transform  f(s)  ■  a (si  -  T)“^  T°f  of  F(*)f  evaluated  at 

s  ■  X. 
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Proof 

If  the  matrix  XI  •  Xe*a  -  T  were  singular,  there  would 
exist  a  vector  u  ^  0,  such  that 

(5)  u  T  +  X  (u  e)  o  -  X  u  ■  0. 

If  u  e  ■  0,  then  the  nonsingularity  of  XI  -  T  implies  that 
u  ■  0 .  As  this  is  a  contradiction,  we  may  normalize  u  by  setting 
u  e  •  1.  Postmultiplying  by  e  in  (5)  now  yields  that  u  ^  »  0, 

and  that  u  ■  Xa(XI  -  T)”^.  It  follows  that 

u  T®  -  X  a(XI  -  T)’^Tf  «  X  f (X)  -  0, 

which  is  clearly  Inqpoasible.  The  vector  u  is  therefore  the  zero 
vector  and  the  matrix  is  nonsingular. 

We  may  now  write 


It  is  immediate  from  (2)  that  a(Xl  -  T)”^  e  ■  1  -  f(X), 

so  that  Formula  (4)  follows  by  elementary  manipulations.  By  using 

classical  properties  of  differential  equations,  it  was  shown  in 

[3]  that  the  vectors  a  exp  (Tx)  and  exp  (Tx)  T®,  are  positive 


6 


fcr  X  >  0.  This  inplies  that  the  vectors  o^CXI  -  T)”^  and 

(XI  -  T)”^  are  positive.  Since  (XI  -  T)”^  is  nonnegative, 
we  conclude  that  the  inverse  in  (4)  is  a  positive  matrix. 

Lemma  2 

The  maximal  eigenvalue 

(6)  R  =  X(XI  -  Xe*a  -  T)“^, 

is  given  by  n  =  X(X  -  c*)~^, 
solution  of  the  equation 

(7)  X  a(cl  -  T)“^  e  *  1. 

Moreover,  if  *-t  is  the  abscissa  of  convergence  of  the  transform 
f(s),  then  -T  <  c*  <  X.  The  eigenvalue  n  is  less  than  one,  if 
and  only  if  X  <  1. 


ri  of  the  positive  matrix 


where  c*  is  the  unique  real 


Proof. 

Let  u  be  the  positive  left  eigenvector  of  R,  corresponding 
to  its  Perron-Frobenius  eigenvalue  n  and  let  u  bo  normalized 
by  u  e  *  1 .  The  equation  u  R  »  n  u ,  leads  to 
Xu«  X  Ru  -  X  no”  nuT,  euid  the  latter  equation  leads,  upon 

postmultiplication  by  e,  to  n  ■  g,  where  d  ■  u  T°  >  0. 

Upon  substitution  into  the  preceding  equation  for  u,  we 

obtain  u  ■  ^  a  “  d)  I  -  ^  Since  u  e  ■  1,  we  now  readily 
obtain  the  equation  (7) . 


J 
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The  function  ^(c)  is  strictly  decreasing,  positive  euid 
convex  on  (-t,  «>)  emd  has  a  pole  at  c  =  -t.  It  tends  to  zero  as 
c  tends  to  infinity.  The  equation  (7)  therefore  has  a  unique 
real  solution.  If  <  1,  then  (^(0)  »  <  1,  so  that  c*  <  0, 

and  therefore  0  <  n  <  1*  If  Xy^  *  1,  we  obtain  <^(0)  =  1,  and 
hence  n  *  1-  If  Xy^  ■  <j>(0)  >  1,  then  c*  is  positive  and 

n  >  1.  Finally  Xa(Xl  -  T)”^  e  =  1  -  f(X)  <  1,  so  that  c*  <  X. 


2.  The  H/PH/1  and  M/PH/l/K-t-1  Queues 

The  M/PH/1  queue  with  Poisson  arrival  rate  X  may  be 
studied  as  a  Markov  process  with  the  state  space 

E=  {0,  (i,  j),  i  si,  1  s  j  sm},  where  the  state  0  corresponds 
to  the  empty  queue  and  (i,  j)  indicates  that  there  are  i  s  1 
customers  present  with  the  service  in  course  in  its  phase  j . 


The  generator  Q  of  that  Markov  process  is  given  by 


Xa  £  £ 

T-XI  XI  0 

T°*a  T-XI  XI 

0  T°*a  T-XI 

0  0  T°*a 


in  block-partitioned  form.  The  pair  (a,  T)  is  here  the  irreducible 
representation  of  the  service  time  distribution  F ( » ) .  By  i,  we 
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denote  the  set  of  states  {(i,  j),  1  ^  j  s  m}. 

The  stationary  probability  vector  x  of  Q  is  partitioned 
into  Xq,  x^,  x^f  •••. »  where  the  vectors  x^,  i  2  1,  are  of 

dimension  m.  It  is  explicitly  given  by  the  following  theorem. 


Theorem  1 

Provided  that  p  »  <  1,  we  have 


=  (1  “  p)  a  for  i  2  l, 

where  R  is  the  matrix,  defined  in  (6). 

Proof 

The  equation  x  Q  *  0,  is  equivalent  to 

-XXq  +  Xj^  T^  ■  0, 

(10)  Xxqu  +  Xi<T  -  AI)  +  (Xj  T°)  a  »  0  ^ 

Ax^_j^  +  x^CT  -  AI)  +  ^2Li+i  2,  “  i  2  2. 

Postmultiplying  each  equation,  but  the  first,  by  e  and  recalling 
that  Te  ■  -  T^,  we  obtain 

T®  ■  Axq, 

x^+1  T°  -  Xx^e,  for  i  2  1. 
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Substitution  into  the  equation  (10),  we  obtain  that 


Xj  (A1  -  -  T)  »  A  Xq  a,  and  “  ^®*£L  “  T)  = 


for  i  2  1. 


It  now  only  remains  to  verify  that  Xq  =  1  -  p.  Since  the 
normalizing  equation  reduces  to 


Xq  +  \  Xq  a  e  =  Xq  +  Xg  a  R(I  -  R)“^  e 


*  x«  a (I  “  R)  e  =  1, 


we  see  that  the  queue  is  stable  if  and  only  if  p  <  1. 

The  preceding  equation  yields  upon  substitution  for  R  that 

Xq  a.U  “  e  *  Xq  a  T(X^.a  +  T)'^  =  Xq  o(I  +  Ae.o^r”^)  e 

00 

“  *0  *0  e  *  Xq  +  Xq  P  (l-p)‘^  *  1, 


since 


-  a  T  e.  This  completes  the  proof  of  the  theorem. 


Corollary  1. 


The  stationary  queue  length  density  at  an  arbitrary  time  is 


given  by 


Vn  “  1  “  P/ 


y^  -  (1-p)  a  R^  e. 


for  i  2  1, 
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This  is  also  the  stationary  density  of  the  queue  length  following 
departures. 


Proof 

Only  the  second  statement  requires  proof.  The  probability 
that  i  customers  remain  following  a  departure  is  given  by 


si.i  f 

"  .o  (1-p)  a  (I-R)"^R  T° 


v»l 


-1 


since  R  t”  =  X  e/  and  (1-p)  a  (1-R)  e  =  1. 


for  i  i  0 


Corollary  2 

Given  that  there  are  i  ^  1,  customers  in  the  stationary 
queue  at  an  arbitrary  time  t,  the  conditional  distribution  of  the 
residual  service  time  is  of  phase  type  with  representation  T) , 

with  given  by 

i  i 

5.1  “  ^  a  R  f  for  i  a  1. 

The  mean  of  this  distribution  is  given  by 

Yi  *  “(a  e)*^Ca  e ) »  for  i  i  1. 


As  i  tends  to  infinity,  the  conditional  distribution  of  the 
residual  service  time  tends  to  the  PH-distribution  with  represen¬ 
tation  (u,  T) ,  where  u  is  the  vector  defined  in  the  proof  of 


Lemma  2 
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The  stationary  distribution  W(*)  of  the  waiting  tine  in 
the  stable  M/PH/1  queue  was  obtained  in  a  particularly  sinple 
form  in  [ 2 ] .  It  is  shown  there  that  W ( • )  is  the  PH-distr ibution 
with  representation  (£,  L) ,  where 

5  =  p  £» 

L  =  T  +  p 

The  S2une  method  of  proof  as  in  Theorem  1  also  leads  to  the 
explicit  solution  of  the  bounded  queue  M/PH/l/K+1,  in  which  all 
customers  arriving,  while  there  are  K+1  customers  in  the  system, 
are  lost. 

Theorem  2 

The  stationary  probability  vector  x  =  |xjj,  Xj^,  ..., 
of  the  generator  Q  for  the  M/PH/l/K+1  queue  is  given  by 

Xj^  *  Xq  a  R^,  for  1  ^  i  £  K, 

^K+1  •  *0  SL 

where  the  matrix  R  is  given  in  Formula  (6)  and  xq  is  given  by 


'Tr'if'iiiiMylBiftoiiM 


Remarks 


a.  The  sum  in  the  preceding  formula  should  not  be 


written  in  closed  form,  since  the  matrix  I  -  R  may  now  be 
singular. 


b.  The  overflow  process  of  an  M/PH/l/K+l  queue  is  an  example 
of  a  Markov-modulated  Poisson  process.  It  may  be  informally  de¬ 
scribed  as  a  Poisson  process  which  is  turned  on  only  when  the 
Markov  process  Q  of  the  M/PH/l/K+i  queue  is  in  one  of  its 
states  (K+1,  j),  1  ^m. 

Further  details  and  applications  may  be  found  in  Neuts  and  Kumar 

C4]. 


3.  The  PH/M/c/K+c  Queue 

We  now  consider  a  service  system  with  c  identical  exponen¬ 
tial  servers,  each  of  rate  y.  The  arrival  process  is  now  a 
renewal  process  of  phase  type,  whose  interarrival  time  distribution 
F ( * )  is  of  phase  type  with  representation  (a ,  T) .  There  are  only 
K  waiting  spaces;  any  customers  arriving,  while  there  are  K  -«■  c 
customers  in  the  system,  are  lost. 

This  queueing  model  may  be  studied  as  a  Markov  process  Q 
on  the  state  space  E>{(i,j),0$i£K+c,lsj  ^m).  The 
index  i  is  now  the  number  of  customers  in  the  queue  and  j  is 
the  phase  of  the  interarrival  process. 


U 
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The  generator  Q  Is  given  by 


Q  = 


T 

mO 

T  'a 

0 

yi 

T-yl 

T®«a 

0 

2yl 

T-2yI 

0 

0 

3yl 

• 

• 

• 

• 

• 

• 

• 

m 

« 

0 

O 

T°.a 

T-3yI 


cyl  T-cyl 
O 

O  0 


T°a 

T-cyl 

cyl 


T+T 


The  stationary  probability  vector  x,  partitioned  into  K  + 

m-vectors  x./  x, ,  , • , ,  x_, satisfies  the  equations 
— O  —1  — K+C 


(11) 


Xq  T  +  y  x^  «  0 

T®)  a  +  x^  (T  -  iyl)  +  (i  +  1)  y  x^^j^  «  0,  for  1 
T®)  a  +  x^  (T  -  cyl)  +  cyx^^j^  =  0,  for  c  s  i  s 

^-K+c-1  -K+c  -°’SL  "  “  2.' 

K+c 


The  sane  device  as  in  Theorem  1  leads  to 
(12)  x^_j^  T®  -  mlnCi,  c)  yx^^e. 


!• 

I 

I 

o 

o^cyl  I 

i 

c  +  1 

s  i  s  c  -  1 
K  +  c  -  1, 


for  1  s  i  s  K  +  c 
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Substitution  into  the  equations  (12),  leads  to 

Xq  - 

x^  »  ti+DWii+l  “  ivie*a  -  T)”^»  for  1  s  i  s  c  -  1 

Si  "  ”  cpe*a  -  T)  for  csisK  +  c-1, 

-K+c  “  2L  (cyl  -  eye -a  -  T)’^, 

K+c 


We  now  set 


R(i)  «  iy(iyl  -  iye*a  -  T)"^, 


for  1  s  i  s  c 


and 


The  following  theorem  then  holds. 
Theorem  3 


The  vector  x  is  given  by 
^Kfl  c-1  ^ 

—0  ^  ®  S  ®  f  I  R  (c^ )  {— yT*"^ ) , 

v«l 

e  ^K+1  c-t  . 

-1  “  Y  I  a  TT  R(c-v), 

v»l 

^K+c-i+1 
Si  -  Y  o  »  (c) , 


for  Isis  c-1. 


for  c  s  i  s  K+c. 
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The  constant  y  is  uniquely  determined  by  the  normalizing  equation. 


Remarks 


The  probability  that  iflsisK^c,  customers  are  present 
immediately  after  an  arrival  is  given  by 


since  by  adding  up  the  equations  (11) ,  we  obtain 


K+c 


K-»c 


e  »  1. 


It  follows  that 


The  stationary  distributions  of  the  waiting  time  at  arrivals 
and  at  an  arbitrary  time  are  easily  computed r  once  the  marginal 
stationary  densities  of  the  queue  length  at  arrivals  and  at  an 
arbitrary  time  are  known. 


4.  The  PH/M/c  Queue 

The  unbounded  PH/M/c  queue  may  be  studied  as  a  Markov 
process,  whose  generator  Q  is  the  obvious  analogue  of  the  matrix 
for  the  bounded  case.  This  queueing  model  does  not  have  a  fully 
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explicit  steady-state  probability  vector.  It  is  nowever  a  sinqple 
exan^le  of  a  Markov  process,  which  in  the  ergodic  case  has  a 
modified  matrix-geomatric  stationary  vector  x.  The  vector  x, 
partitioned  into  m-vectors  x^,  i  2  0,  is  of  the  form 

.2 


*0'  “1 


«C-1'  2c-l®'  2c-i* 


The  matrix  R  is  now  the  minimal  nonnegative  solution  to 
the  matrix-quadratic  equation 


(13)  cwR^  +  R(T  -  cyl)  +  if*,  a  ■  0. 

The  matrix  R  has  its  maximal  eigenvalue  less  than  one,  if  and 
only  if  cy  >  usual  equilibrium  condition  for 

the  Gl/M/c  queue. 

The  vectors  Xq,  ...,  x^  j^,  satisfy  the  equations 


XgT+yXj-0, 


(14)  S*)  «  (T  -  iyl)  (i  +  1)  yx^^.j^  ■  0,  for  Isis  c-2, 

t2c-2  2c-l  yl  +  cy  -  0, 


c-2 


XiS  +  Xg_j^  Cl  -  R)“^  e  -  1. 


By  postmultiplying  by  e  in  (13)  and  recalling  that  1  -  R 
is  nonsingular,  we  obtain 

(15)  cy  R  e  -  T**. 


By  the  same  device  as  In  the  proof  of  Theorem  1,  we  may 


transform  the  equations  (14)  for  c  ^  2,  Into 


Xq  -  -  y  T  , 


-1 


■  (i+1)  y  (iyl  -  iye*a  -  T)  ,  for  Isis  c-2 

x^_j^  |jc-l)yl  -  (c-1)  ye-a  -  T  -  cy^  ■  0, 


c-2 


x.e  +  X  .  (I  -  R)"^  e  »  1. 


The  penultimate  equation  determines  the  vector  x  ,  up  to  a 

multiplicative  constant.  It  is  now  obvious  how  all  the  vectors 
nay  be  uniquely  determined. 

The  preceding  statements  all  follow  by  applying  general 
theorems  proved  in  C5].  We  shall  limit  our  discussion  here  to 
that  of  some  computational  aspects. 

The  matrix  R  is  computed  by  successive  substitutions  in 
the  equation 

R  ■  R^  cy(cyl  -  T)”^  +  T°.o  (cyl  -  T)“^. 

It  is  readily  seen  that  T®  -  0,  implies  that  the  j-th  row  of  R 

is  zero.  The  rows  with  index  j  such  that  T®  >  o,  are  strictly 
positive. 
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r 


The  latter  observation  Is  very  useful,  when  m  is  large, 

but  the  vector  has  few  positive  entries.  In  the  case  of  the 

Ej^M/c  queue,  for  example,  one  may  readily  verify  that  the  only 
non-zero  row  of  R  is  the  m-th  row,  given  by 


“mj  -  '"W''' 


for  1  ^  j  ^  m. 


The  quantity  u  »  (R  , )  ,  is  the  unique  root  in  (0,  1)  of  the 
in  ml 


equation 


i^+cy-cp  s 


The  vectors  x^,  ...,  <wy  be  computed  as  Indicated 

above.  In  rare  cases,  where  this  recursive  method  of  solution 
leads  to  overflow,  the  equations  (16)  may  be  solved  iteratively, 
using  the  normalizing  equation  to  keep  the  successive  iterates 
within  a  compact  set. 

The  stationary  distribution  W(*}  of  the  virtual  waiting 
time  is  readily  seen  to  be  given  by 


(17)  W(x) 


= '  -  i..,  [-  •’f-* 
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for  X  2  0.  It  nay  easily  be  conputed  by  numerical  solving  the 
differential  equations 

V’  (x)  -  v{x)  cv(R  -  I) , 

-  ic-l 

Similar  equations  may  be  derived  for  the  distribution  of  the 
waiting  time  at  arrivals. 
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